Statistical-Computational Phase Transitions in Planted Models: The High-Dimensional Setting
نویسندگان
چکیده
The planted models assume that a graph is generated from some unknown clusters by randomly placing edges between nodes according to their cluster memberships; the task is to recover the clusters given the graph. Special cases include planted clique, planted partition, planted densest subgraph and planted coloring. Of particular interest is the high-dimensional setting where the number of clusters is allowed to grow with the number of nodes. We show that the space of model parameters can be partitioned into four disjoint regions: (1) the impossible regime, where all algorithms fail; (2) the hard regime, where the computationally intractable Maximum Likelihood Estimator (MLE) succeeds, and no polynomial-time method is known; (3) the easy regime, where the polynomial-time convexified MLE succeeds; (4) the simple regime, where a simple counting/thresholding procedure succeeds. Moreover, each of these algorithms provably fails in the previous harder regimes. Our theorems establish the first minimax recovery results for the high-dimensional setting, and provide the best known guarantees for polynomialtime algorithms. These results demonstrate the tradeoffs between statistical and computational considerations.
منابع مشابه
Statistical-Computational Tradeoffs in Planted Models: The High-Dimensional Setting
The planted models assume that a graph is generated from a set of clusters by randomly placing edges between nodes according to their cluster memberships; the task is to recover the clusters given the graph. Special cases include planted clique, planted partition and planted coloring. This paper studies the statisticalcomputational tradeoffs of these models. Our focus is the high-dimensional se...
متن کاملSharp Computational-Statistical Phase Transitions via Oracle Computational Model
We study the fundamental tradeoffs between computational tractability and statistical accuracy for a general family of hypothesis testing problems with combinatorial structures. Based upon an oracle model of computation, which captures the interactions between algorithms and data, we establish a general lower bound that explicitly connects the minimum testing risk under computational budget con...
متن کاملDynamical phase transitions in periodically driven model neurons.
Transitions between dynamical states in integrate-and-fire neuron models with periodic stimuli result from tangent or discontinuous bifurcations of a return map. We study their characteristic scaling laws and show that discontinuous bifurcations exhibit a kind of phase transition intermediate between continuous and first order. In the model-independent spirit of our analysis we show that a six-...
متن کاملMaterials for “ Statistical - Computational Phase Transitions in Planted Models : The High - Dimensional Setting ”
We provide the proofs for the theorems in the main paper. 1 Proofs for Planted Clustering In this section, Theorems 1–6 refer to the theorems in the main paper. Equations are numbered continuously from the main paper. We let n1 := rK and n2 := n − rK be the numbers of nonisolated and isolated nodes, respectively. 1.1 Proof of Theorem 1 The proof relies on information theoretical arguments and t...
متن کاملشبیه سازی ذوب سیستمهای دو بعدی
The study of a two-dimensional (2-D) system started nearly half a century ago when Peierls and Landau showed the lack of long range translational order in a two-dimensional solid. In 1968, Mermin proved that despite the absence of long range translational order. Two-dimensional solids can still exhibit a different kind of long range bond orientation. During the last decade, fascinating theori...
متن کامل